Spatially Adaptive Bayesian Penalized Splines With Heteroscedastic Errors

نویسندگان

  • Ciprian M. Crainiceanu
  • David Ruppert
  • Raymond J. Carroll
  • Adarsh Joshi
  • Billy Goodner
چکیده

Penalized splines have become an increasingly popular tool for nonparametric smoothing because of their use of low-rank spline bases, which makes computations tractable while maintaining accuracy as good as smoothing splines. This article extends penalized spline methodology by both modeling the variance function nonparametrically and using a spatially adaptive smoothing parameter. This combination is needed for satisfactory inference and can be implemented effectively by Bayesian MCMC. The variance process controlling the spatially adaptive shrinkage of the mean and the variance of the heteroscedastic error process are modeled as log-penalized splines. We discuss the choice of priors and extensions of the methodology, in particular, to multivariate smoothing. A fully Bayesian approach provides the joint posterior distribution of all parameters, in particular, of the error standard deviation and penalty functions. MATLAB, C, and FORTRAN programs implementing our methodology are publicly available.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Spatially Adaptive Bayesian Regression Splines

In this paper we study penalized regression splines (P-splines), which are low–order basis function splines with a penalty to avoid undersmoothing. Such P–splines are typically not spatially adaptive, and hence can have trouble when functions are varying rapidly. While frequentist methods are available to address this issue, no Bayesian techniques have been developed. Our approach is to model t...

متن کامل

Spatially Adaptive Bayesian Penalized Regression Splines (P-splines)

In this paper we study penalized regression splines (P-splines), which are low–order basis splines with a penalty to avoid undersmoothing. Such P–splines are typically not spatially adaptive, and hence can have trouble when functions are varying rapidly. Our approach is to model the penalty parameter inherent in the P–spline method as a heteroscedastic regression function. We develop a full Bay...

متن کامل

Bayesian mixture of splines for spatially adaptive nonparametric regression

A Bayesian approach is presented for spatially adaptive nonparametric regression where the regression function is modelled as a mixture of splines. Each component spline in the mixture has associated with it a smoothing parameter which is defined over a local region of the covariate space. These local regions overlap such that individual data points may lie simultaneously in multiple regions. C...

متن کامل

On Semiparametric Regression with O'sullivan Penalized Splines

An exposition on the use of O’Sullivan penalized splines in contemporary semiparametric regression, including mixed model and Bayesian formulations, is presented. O’Sullivan penalized splines are similar to P-splines, but have the advantage of being a direct generalization of smoothing splines. Exact expressions for the O’Sullivan penalty matrix are obtained. Comparisons between the two types o...

متن کامل

Benchmarking Bayesian neural networks for time series forecasting

We report a benchmarking of neural networks and regression techniques in a time series forecasting task. The estimation errors, computing costs and additional information obtained by Bayesian neural networks are compared with other neural network models and with Multivariate Adaptive Regression Splines (MARS). The Mackey Glass time series in chaotic regime was used to generate the two data sets...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2007